Multimodal approaches to video analysis of digital learning environments
نویسندگان
چکیده
Contemporary digital learning environments, such as tangibles, mobile and sensor-based technologies are inherently multimodal, both in terms of representation modalities and interaction modes. Drawing on social semiotics, multimodality offers a valuable approach for analysing video data, as it systematically attends to the interpretation of a wide range of communicational forms (e.g. gaze, posture, action, speech) used for making meaning. This paper explores a multimodal approach to video data in the context of ubiquitous technologies for learning.
منابع مشابه
The role of touch in preschool children’s learning using iPad versus paper interaction
Touch-based interaction is increasingly a key feature of digital learning environments, yet we know little about the specific ways in which digitally mediated touch reshapes interaction for very young children. This paper examines how finger painting processes, a common activity in early years learning environments, might change in digital (iPad) versus physical (paper) learning environments. I...
متن کاملUsing Multimodal Learning Analytics to Study Learning Mechanisms
In this paper, we propose multimodal learning analytics as a new approach for studying the intricacies of different learning mechanisms. More specifically, we conduct two analyses of a hands-on, engineering design study (N=20) in which students received different treatments. In the first analysis, we used machine learning to analyze hand-labeled video data. The findings of this analysis suggest...
متن کاملAchieving Multimodal Cohesion during Intercultural Conversations
How do English as a lingua franca (ELF) speakers achieve multimodal cohesion on the basis of their specific interests and cultural backgrounds? From a dialogic and collaborative view of communication, this study focuses on how verbal and nonverbal modes cohere together during intercultural conversations. The data include approximately 160-minute transcribed video recordings of ELF interactions ...
متن کاملThe impact of proactive and reactive focus on form in multimodal settings on EFL learners' comprehension and production of modal auxiliaries
The major objective of this mixed methods research, which considered elements of both quantitative and qualitative research approaches, was to examine the effect of two different types of focus on form instruction, namely proactive and reactive across multimodal vs. traditional input settings on Iranian EFL learners' comprehension and production of modal auxiliaries. The participants of the stu...
متن کاملPupils ́ interaction and learning in four Social Science Learning Design Sequences
This article concerns the use of digital learning resources in the Swedish Social Science classroom. The aim is to find specific patterns in pupils ́ subject related interaction and learning when they work with digital learning resources. This is illustrated by means of a Learning Design Sequence LDS which is a model for research and analysis developed within the project Digital media and learni...
متن کامل